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Abstract 


The position occupied by the geoid in the computation of orthometric height (H) from GNSS 
observations is crucial and hence requires the geoid model parameters obtained with the application of 
least squares technique, be approximated to a reasonable number of significant figures in its (geoid) 
modelling to enable a high-resolution geometric geoid, be determined. As a result, this study presents the 
implication of significant number in geodetic computations using geometric geoid model of FCT, Abuja 
as a case study. The number of significant figures of the model parameters was varied, starting from 6 to 
22 significant figures to enable the Root Mean Square Errors (RMSEs), as well as the accuracy of the 
model, be obtained at the varied numbers of significant figures. The obtained results show that the highest 
accuracy of the model is obtained if the model parameters are approximated to a reasonable number of 
significant figures. 
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1 Introduction 

The importance of geoid has resulted in its listing or opined by Dodo and Idowu (2010) and others as a 
requirement of National Geospatial Data Infrastructure (NGDI) and therefore involving geodetic 
computations using space technique of GPS/GNSS. Geodetic computations require evaluation of 
significant numbers for acceptable and meaningful results to be obtained. 

The study involves the computations of geoid undulation (N) by geometric geoid method. Oluyori 
(2019) suggest or opined the geoid to be essentially an equipotential and continuous surface highly 
consistent for vertical reference surface for heights in the metric unit and ensures height continuity across 
borders. 

Significant numbers/figures most importantly give us useful information about the accuracy of 
measurements and computations made and recorded i.e. resolution. For example, if a measurement of 
1000 has one significant figure/digit (s.f /d) while 1000.0 has five s.f because the .0 has something 
interesting to tell us about accuracy being made to the tenth or the decimal means that measurement was 
made to the nearest unit. In other words, significant figures can be viewed as a number contributing 
something to the precision of the number. Or by calculations introduce more precision than the given or 
original data, e.g. N=22.787m and by calculation N=22.78746m. In geometric geoid modelling, the 
model parameters are computed using the least squares technique. Most of these parameters usually 
contain a large number of zeros resulting in a small number of significant figures. As a result, they are 
usually approximated to zero without considering the effect of ignoring the significant numbers they 
contain, in the accuracy of the model. Consequently, this study presents the implication of significant 
number in geodetic computations using geometric geoid model of FCT, Abuja as a case study. 

1.1 Mathematical Models 

Consider numbers (small or big) that can be multiplied, divided, added, subtracted and may be written 
as exponentials:- 
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a o =b o xl0 c (1) 

Then similarly 

a, -b x xlO el (2) 

The multiplication is 

=b 0 b l xlO c+cl (3) 

Division is given by 

a o /a l =(b o /b l )xl0™ 1 (4) 

For addition and subtraction, we have 

a Q ±a i = (b 0 +b [ )x 10 e±el (5) 


In performing calculations, significant numbers could be lost sometimes and this is expected due to 
measurement uncertainty associated. To typify the numbers and their various calculations, the flowchart, 
as well as Figure 1, is explanatory. 



Figure 1: Flow Chart of Model 
Source: Michael (2016) 


For a number to carry meaning in any measurement resolution, the number of significant figures and 
digits must be known. To do this, numbers are classified into: 

i. All non-zero digits are significant e.g. 1,2,3,4,5,6,7,8,9. 

ii. Zeros between non-zero digits are significant e.g. 102.7005, etc. 

iii. Leading zeros are never significant e.g. 002, 008767, 000000034. 

iv. In a number with or without a decimal point, trailing zeros (those to the right of last non-zero digit 
are significant, provided they are justified by the precision of derivation: 389,000; 2002000; 5.400. 
or as summarized and detailed in https://www.usna.edu . 

The final results of geodetic computations in this study or any such other must contain the same number 
of the significant figures as the original number with the fewest significant figures as opined by 
https://courses.lumenlearning.con . It is opined by ESA (2014) that in fact “the number should be given 
in 2 - 3 effective digits” and further that the decimal rule that ignores significant digits is never acceptable 
or cannot work. 

These specifications may be put graphically under rules (S or NS) shown in Figure 2. 
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Figure 2: Significant or Not Figures Rules 
Source https://getstartedinscience.weedly.com 

Details can also be found in standard mathematics textbooks. 

The model considered for FCT surface fitting in the case study is the multi-quadratic model (nine 
parameters) given by Sanlioglu et al. (2009) and Oluyori et al. (2018) as 

2 2 2 2 2 2 

N = a 0 +a l x + a 2 y + a 3 x +a 4 y + a 5 xy + a 6 x y + a 7 xy +a%x y ( 6 ) 

Where v and y are the DGPS known coordinates, ao, ai, a 2 ... are the parameters to be determined and N 
is the geoid undulation. 

1.2 Observation Equations (Least Squares Adjustment) 

Observation equations are written for the parametric model as one equation for each observation and 
generally as given in Ono et al. (2014), 

AX =L ( 7 ) 

Where A is a design matrix, X is the coefficients and L is the measurements. 

When the number of measurements (m) is greater than the number of unknowns (n) (m>n), then we have 
redundant observations, as well as degrees of freedom (d.o.f) requiring least squares adjustments 
solutions. When there are redundant equations, the system is said to be over-determined: A is not a square 
matrix but A T A is a square matrix, according to Ono et al. (2014), 

A t AX = A t L ( 8 ) 

Let N = A T A and n = A r L 
Then X = N~ l n. This implies that 


NX =A t L 


(9) 


For unit weight, the solution is given as 

X=(A t A)-\A t L) ( 10 ) 

Here, the unit weight is due to equal reliability of observations. 
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Where, 

A = Design matrix. 

X = Vector of unknown parameters/coefficients. 

P = Weight matrix = 1 
L = Geoid undulations (N=h- H). 

To use the least squares solution, first solve for the values of the polynomial constants ( ao, <27,..., a n ) using 
the computed geoidal undulation (N) values and the known northing (y or n) and easting (x or e) 
coordinates of the observation/control points. The computed polynomial constants, and the differences 
between the centroid and the observation points’ coordinates, are substituted into the polynomial model 
(multi-quadratic) to obtain the model geoid heights of points in the study area. 

1.3 Root Mean Square Error 

The Root Mean Square Error, RMSE index for the computation of the geometric geoid model accuracy 
as given by Eteje and Oduyebo (2018) is 

lv T v 

RMSE = ±J - ( 11 ) 

V n 

Where, 

^ = Nknown — Nmodel (Residual) 

Nknown = Known geoid height of point 
Nmodel — Model geoid height of point 
n = Number of points 
2 Methodology 

The methodology adopted for the derivation of the geoid heights used to determine the geometric geoid 
model of FCT, Abuja, Nigeria, given in Table 1, is detailed in Oluyori et al. (2019). 


Table 1: Coordinates and Geoid Heights of Points 


Control 

Points 

Easting (e)x (m) 

Northing (n)y 
(m) 

Computed 
Geoid Heights 

(m) 

FCC11S 

331888.114 

998442.043 

23.949 

FCT260P 

255881.175 

993666.807 

22.787 

FCT103P 

340639.766 

998375.578 

24.278 

FCT12P 

333743.992 

1008308.730 

24.485 

FCT19P 

337452.408 

996344.691 

24.180 

FCT2107S 

308926.908 

989748.256 

24.187 

FCT2168S 

310554.927 

1009739.930 

24.183 

FCT24P 

322719.776 

1001884.850 

24.276 

FCT276P 

351983.716 

1025998.314 

24.251 

FCT4154S 

329953.882 

1003831.280 

24.323 

FCT4159S 

326124.422 

1003742.860 

24.004 

FCT66P 

299148.035 

998114.283 

24.440 

FCT9P 

329821.512 

1007612.091 

24.128 

FCT35P 

322183.380 

992926.363 

23.951 

FCT57P 

303234.270 

992916.402 

24.350 

FCT4028S 

330164.634 

1001388.240 

24.012 

FCT53P 

308943.361 

993406.773 

24.402 

FCT4652S 

329441.767 

997474.808 

25.395 

FCT162P 

270791.291 

934625.533 

23.775 

FCT130P 

330982.584 

952889.869 

24.195 

FCT2327S 

282526.612 

973821.470 

24.789 

FCT2652S 

271370.273 

945385.429 

24.505 

FCT2656S 

272644.591 

941062.460 

24.067 

FCT83P 

332954.205 

987231.606 

23.804 

XP382 

284074.729 

983364.863 

23.949 
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The model parameters were computed using the least squares method, as well as equation (10). The least 
squares model in matrix notation used for the computation of the model parameters is, 


fl 
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The computed model parameters using the multi-quadratic surface, are given in matrix form as 


(a ^ 

01 0 


" 24.2248901210000000000 ' 

a x 


- 0.00002409340580587179 

a 2 


- 0.00008013620770038382 

a 3 


0.00000000009699046795 

a 4 

= 

0.00000000370280953876 

a 5 


0.00000001166702184889 

a 6 


- 0.00000000000021600943 

a 7 


- 0.00000000000045716237 

V^8 ) 


v 0.00000000000000000886 y 


The computed model parameters were substituted into the multi-quadratic surface, as well as equation 
(6) at varying numbers of significant figures, starting with 6 significant figures to compute the model 
geoid heights of the points. The commencement of the experiment using 6 significant figures was as a 

result of the number of zeros before the first significant figure in the model parameter- a x . If any 
significant figure less than 6 was used, the computation result would have been the corresponding model 
parameters- a 0 value and would have also been constant for all the points. The numbers of significant 
figures used in this study ranged from 6 to 22 as the computation started with 6 significant figures in the 
model parameter- a x and ended with the 3 significant figures in the model parameter- . The 
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computation was carried out using a Microsoft Excel program developed during the determination of the 
local geometric geoid model of FCT, Abuja. The root mean square error (RMSE) of the model was also 
computed at the varying numbers of significant figures to obtain the accuracy of the model. The 
computation was done by comparing the model geoid heights of the points at the varying numbers of 
significant figures with their respective computed geoid heights to obtain the residuals. The obtained 
residuals and the total number of points were applied in equation (11) to obtain the RMSE, as well as the 
accuracy of the model at the varying numbers of significant figures. 

3 Results Presentation and Analysis 

Table 2 presents the computed RMSE of the model at the varying numbers of significant figures. It was 
done to obtain the accuracy of the model at the varying numbers of significant figures. Also, Figure 3 
presents the plot of the computed model RMSE at the varying numbers of significant figures. It was done 
to show graphically, the accuracy of the model at the varying numbers of significant figures. Here, the 
accuracy of the model varies inversely to the height of the plotted RMSE. It can be seen in Table 2 that 
the RMSE of the model from 6 to 22 significant figures are respectively 0.441m, 2.421m, 2.463m, 
2.509m, 5.743m, 9.373m, 10.522m, 10.637m, 10.649m, 11.074m, 13.279m, 13.734m, 13.738m, 
13.740m, 1.338m, 0.144m and 0.110m. At 6 significant figures, the model geoid height of the points was 
constant for all the points and the value was 24.225m. It was as a result of the number of significant 

figures of the model parameters- a x and a 2 that start from 7 significant figures relative to the model 
parameter- a 0 . Obtaining a constant geoid height for all the points is not possible and it implies that in 
geometric geoid modelling when there are a large number of zeros appearing before a significant figure 
in the other computed parameters, the model parameter- a o should not be approximated to a significant 

figure equal the number of zeros before the significant figures in the other model parameters. The 
accuracy of the model from 7 to 19 significant figures ranges from 2.421m to 13.740m. Here, as the 
number of zeros (not significant) in the model parameters increases relatively with an increase in the 
numbers of significant figures from 7 to 19, the computed values of the RMSE increase. It implies that 
the larger the number of significant figures ignored as a result of a large number of zero digits, the less 
the accuracy of the model. It can also be seen in Table 2 that from 20 to 22 significant figures, the 
respective computed values of the RMSE of the model are 1.338m, 0.144m and 0.110m. They also 

correspond to the 3 significant figures of the model parameter- a % . This also implies that in geometric 

geoid modelling, the highest accuracy of the model is obtained if the model parameters are approximated 
to a reasonable number of significant figures. It can again be seen in Figure 3 that the smallest bar of the 
plotted RMSE, is obtained at 22 significant figures. This again implies that the accuracy of the model is 
highest when the model parameters are approximated to a reasonable number of significant figures. 


Table 2: Computed RMS Errors at Varying Numbers of Significant Figures 



6 

Significant 

Figure 

7 

Significant 

Figure 

8 

Significant 

Figure 

9 

Significant 

Figure 

10 

Significant 

Figure 

11 

Significant 

Figure 

RMSE (m) 

0.441 

2.421 

2.463 

2.509 

5.743 

9.373 



12 

Significant 

Figure 

13 

Significant 

Figure 

14 

Significant 

Figure 

15 

Significant 

Figure 

16 

Significant 

Figure 

17 

Significant 

Figure 

RMSE (m) 

10.522 

10.637 

10.649 

11.074 

13.279 

13.734 



18 

Significant 

Figure 

19 

Significant 

Figure 

20 

Significant 

Figure 

21 

Significant 

Figure 

22 

Significant 

Figure 


RMSE (m) 

13.738 

13.740 

1.338 

0.144 

0.110 
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Figure 3: Computed Geoid Model RMS Errors at Varying Numbers of Significant Figures 

4 Conclusion 

In conclusion, the study has presented the implication of significant figures in geodetic computations, as 
well as geometric geoid modelling by varying the numbers of significant figures of the geometric geoid 
model parameters, computing the RMSE, as well as the accuracy of the model and comparing the 
computed accuracy at the varied numbers of significant figures. The results of the study have shown that 
the larger the number of significant figures ignored as a result of a large number of zero digits, the less 
the accuracy of the model. The study has also revealed that in geometric geoid modelling, the highest 
accuracy of the model is obtained if the model parameters are approximated to a reasonable number of 
significant figures. 
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